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ABSTRACT 


The  objective  of  this  investigation  is  the  formulation  of  clear  and 
rigorous  mathematical  criteria  for  system  effectiveness.  Although  the 
investigation  was  in  part  motivated  by  mistrust  of  the  use  of  expected 
values  (first  moments)  for  such  purposes,  their  use  is  evidently  vindicated. 
A  set  of  intuitively  acceptable  axioms  which  define  the  desiderata  required 
of  possible  measures  of  effectiveness  is  established.  It  is  then  shown  that 
these  axioms  are  sufficient  to  determine  a  measure  of  effectiveness. 
Peripheral  material  on  the  theory  of  random  sets  relevant  to  effectiveness 
computations  is  presented  in  appendix  form. 


I. 


INTRODUCTION 


With  the  frequent  and  increasing  need  for  systematic  and  reliable 
examination  of  large  classes  of  system  possibilities  for  determination  of  the 
more  promising  co  irations,  has  come  a  correlative  need  for  a  systematic, 
reliable,  and  uniform  method  for  rating  their  performance  potential.  It  is 
the  objective  of  this  study  to  produce  at  least  the  beginning  of  such  a  method. 
While  no  claim  for  completeness  or  finality  is  in  order,  it  is  clear  that  some 
significant  progress  toward  this  end  is  made  in  the  formulations  and  results 
of  this  study. 

The  central  problem  which  is  broached  in  the  study  is  in  part  semantic 
and  in  part  mathematical.  It  is  in  essence  the  question  of  what  is  meant  by 
performance  potential  and  how  can  clear  mathematical  expression  be  imposed 
upon  the  meaning,  if  such  exists.  The  approach  is  to  establish  several 
properties  which  a  measure  of  performance  potential,  or  effectiveness  as  it 
will  be  termed  later,  would  seem  to  need.  The  determination  of  need  is 
intuitive,  and  therefore  somewhat  arbitrary;  but  it  is  only  the  results  of  such 
a  determination  which  are  incorporated  into  the  analysis  in  the  form  of 
assumptions  solely  of  a  mathematical  nature.  These  assumptions  appear  as 
requirements  which  it  is  desired  that  any  measure  of  performance  potential 
satisfy.  As  requirements,  they  intuitively  appear  as  quite  necessary  properties 
of  anything  that  could  reasonably  be  conceived  as  a  measure  of  performance 
potential  of  any  significant  generality.  It  fortunately  happens  that  these 


I 


assumptions  or  requirements  are  sufficient  to  determine  a  quantitative 
measure  of  performance  potential  which  is  unique  up  to  a  constant  multiplier, 
usually  chosen  equal  to  1.  It  is  this  quantitative  measure  which  is  termed 
'effectiveness'. 

In  the  course  of  conducting  this  investigation  a  number  of  peripheral 
items  have  been  explored,  usually  with  inconclusive  results  and  with  no  results 
of  immediate  applicability  to  the  central  problem.  One  of  these  items, 
however,  is  important  enough  to  the  development  of  effectiveness  applications 
and  further  theory  that,  although  it  is  only  incompletely  incorporated  into  the 
general  abstract  formulation,  it  is  nevertheless  presented  in  some  detail. 

This  item  pertains  to  the  theory  of  random  sets  and  contains  some  very  useful 
generalizations  of  existing  theory.  This  material  is  treated  independently  of 
the  rest  and  is  mainly  developed  in  Appendix  I. 

Similarly,  an  extension  of  the  basic  notion  of  effectiveness  to  include  a 
'conditional'  effectiveness,  which  is  not  complete  enough  to  fit  smoothly  into 
the  general  development,  is  considered  in  Appendix  II.  This  material  too, 
when  properly  developed,  should  provide  a  broader  basis  for  an  effectiveness 
analysis  and  allow  a  component  analysis  of  larger  systems  well  adapted  to 
disclosing  weak  links. 
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II. 


DISCUSSION 


Two  of  the  major  difficulties  implicit  in  the  development  of  a 
satisfactory  theory  for  rating  performance  potential  are  the  ambiguities 
usually  associated  with  the  objectives  of  goals  of  a  system  and  the  inherent 
randomness  of  the  operation  of  most  systems.  The  first  of  these  difficulties 
is  ignored  for  the  most  part  in  this  analysis,  although  it  does  not  appear 
entirely  outside  the  scope  of  effectiveness  theory.  The  analysis  assumes  that 
the  goals  of  the  system  in  all  situations  are  known  and  that  it  is  also  known 
when  these  goals  are  or  are  not  gained  by  the  operating  system.  These 
assumptions,  or  rather  the  details  withheld  by  these  assumptions,  are  brought 
into  the  general  analysis  by  initially  assuming  that  the  result  of  operating  a 
system  for  given  objectives  under  given  conditions  can  be  represented  by  a  real 
valued  non-negative  random  variable.  Later  it  is  shown  by  example  how,  in 
cases  of  practical  significance,  these  random  variables  can  be  obtained  from  a 
detailed  statement  of  the  goals,  their  random  elements,  and  the  random  actions 
and  reactions  of  the  system.  The  second  of  these  difficulties,  and  perhaps  the 
greater  from  the  aspect  of  the  typical  analysis  of  a  system,  is  the  main 
objective  of  the  investigation. 

The  difficulty  of  inherent  randomness  in  its  full  generality  and 
vagueness  can  be  stated:  given  that  the  work  that  a  system  does,  or  the  value 
of  the  goals  it  obtains,  is  a  random  variable,  what  knowledge  of  this  random 
variable  is  necessary  to  determine  how  well  the  system  is  performing  its 
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assignment  and  how  is  this  determination  to  be  made,  particularly,  when  the 
assignment  itself  must  be  considered  random.  A  not  too  illuminating  version 
of  this  difficulty  is  frequently  seen  as  some  conundrum  similar  to  "Is  it  better 
to  kill  half  the  enemy  all  the  time  or  all  of  the  enemy  half  of  the  time?" 

To  clarify  at  least  the  basis  for  such  a  conundrum,  consider  simple 
problems  which  will  alternately  be  considered  from  different  viewpoints. 

Let  there  be  a  simple  system  designed  to  determine  the  presence  or  absence 
of  (say)  a  particle  in  a  given  volume  of  space  at  each  instant  of  time.  Let 
the  only  property  of  the  system  that  might  interfere  with  such  a  determination 
be  the  time  to  failure  of  the  system.  For  simplicity  let  the  time  to  failure 
have  an  exponential  distribution  given  by 

Pr  {  T*  S  t}  =  1  -  e-t/T 

when  T#  is  the  random  time  to  failure  and  T  is  the  mean  time  to  failure. 

Let  the  time  interval  of  interest  be  from  0  to  TQ.  Let  the  probability  that 
a  particle  ever  appears  be  p  and  let  the  time  at  which  it  appears  have  a 
uniform  distribution  from  0  to  TQ  when  it  does  appear. 

Now  that  the  situation  has  been  defined,  consider  what  the  objective 
of  such  a  simple  system  might  be.  It  might  be  that  the  goal  of  the  system 
is  to  provide  certain  knowledge  of  whether  the  particle  did  or  did  not  appear. 

It  might  be  to  provide  knowledge  only  when  the  particle  does  appear.  It 
might  be  to  determine  whether  the  particle  appeared  at  least  with  a  probability 
(say)  c.  All  of  these  objectives  are  somewhat  similar  and  yet  in  important 
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ways  dissimilar:  all  of  them  might  be  the  objectives  of  the  system  under 
different  circumstances,  or  under  the  same  circumstances  as  seen  by 
different  people. 

In  the  first  case  certain  knowledge  can  be  obtained  if,  and  only  if, 
either  the  particle  appears  and  is  detected  or  the  particle  does  not  appear 

and  the  system  fails  after  T  .  Hence,  in  the  first  case  the  effectiveness 

.  _T  /x 

might  be  the  probability  of  this  event,  which  is  pT  (1  -  e  °  )/TQ  + 

-T  / T 

(1  -  p)  e  °  .  In  the  second  case  the  required  knowledge  is  provided  if, 

and  only  if,  the  particle  either  appears  and  is  detected  or  does  not  appear. 

Again  the  effectiveness  might  reasonably  be  identified  with  the  probability 

that  the  required  knowledge  is  supplied;  the  effectiveness  is  then  1  -  p  + 

-T  /T 

pT  (1  -  e  °  )/T  .  The  magnitude  of  the  difference  between  these 

-T  / T 

quantities  is  (1  -  p)  (1  -  e  °  )  so  that  not  only  are  the  formula  different 

but  also  the  results  may  be  significantly  different.  In  the  third  case  the 

-T  / T 

effectiveness  is  0  or  1  as  e  °  is  less  than  or  not  less  than  c,  when  that 
case  is  handled  as  the  preceding  ones.  Thus,  there  is  ample  ground  for 
confusion  and,  needless  to  say,  when  more  than  one  particle  is  involved 
matters  are  worse. 

As  important  and  as  extreme  as  this  confusion  is,  it  is  not  of  direct 
consequence  for  the  question  of  what  knowledge  of  the  random  variables 
characterizing  the  work  the  system  accomplishes  and  the  work  assigned  is 
necessary  for  the  determination  of  effectiveness,  or  what  means  are  to  be 
used  in  the  determination.  The  present  analysis  assumes  that  a  proper 
choice  of  random  variables  has  been  made,  if  such  can  be  done. 
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The  interpretation  of  the  random  variables  designated  'work  assigned' 
and  'work  accomplished'  is  that  the  random  variables  considered  as  functions 
on  their  underlying  probability  space  take  as  values  quantities  that  would 
represent  an  actual  assignment  and  an  actual  accomplishment  if  the  random 
effects  were  suppressed.  Thus  'work  assigned'  will  be  taken  to  mean  that 
body  of  material  or  things  which  a  system  is  desired  to  transform  in  some 
specified  way,  or  some  real  valued  function  of  that  body  which  can  be 
interpreted  as  a  value  or  worth  assignment.  Similarly,  'work  accomplished' 
will  be  taken  to  mean  that  portion  of  the  body  properly  transformed  or  a  real 
valued  function  of  that  portion. 

Usually  the  work  assigned  and  the  work  accomplished  will  be  non¬ 
negative,  real  valued  random  variables.  Occasionally,  however,  these 
random  variables  may  degenerate  into  real  numbers.  Thus,  there  is  a 
special  case  in  which  the  effectiveness  functional  must  be  evaluated  for  real 
arguments.  In  this  case,  one  can  require  with  confidence,  that  the 
effectiveness  increase  in  direct  proportion  to  the  accomplished  work  for  a 
constant  assigned  work.  Thus,  if  W  designates  the  assigned  work,  S 
designates  the  accomplished  work,  ef(.  ,  .  )  the  effectiveness  functional,  and 
C(.  )  an  unspecified  positive  decreasing  function,  then 

ASSUMPTION  I 

The  restriction  of  the  effectiveness  functional  to  the  real  numbers 


satisfies 


ef(S,.W)  =  C(W)S 


(1) 


when  W>  0  and  0$  Sj  W. 

When  the  work  assigned  and  the  work  accomplished  are  not  necessarily 
degenerate  random  variables,  it  is  necessary  to  proceed  differently.  The 
essence  of  the  next  requirement  is  balance:  if  the  work  assigned  and  the  work 
accomplished  are  both  augmented  in  such  a  manner  that  the  balance  between 
the  two  is  unchanged,  then  the  effectiveness  is  unchanged.  In  different  words 
the  requirement  might  be  that  the  effectiveness  remain  constant  when  the 
assigned  work  varies,  provided  that  the  accomplished  work  varies 
proportionately.  In  dealing  with  random  quantities  a  better  vantage  can  be 
obtained  by  looking  at  'proportionately'  from  a  viewpoint  different  from  the 
usual. 

Let  f  be  a  continuous  real  valued  function  of  a  real  variable.  Let  f 

be  non-negative  and  increasing  for  an  increasing  non-negative  argument;  also 

•*> 

let  f (0 )  =  0.  Such  a  function  is  of  the  form  f(x)  =  mx,  m  >  0  if,  and  only  if, 
equal  increments  in  the  argument  produces  equal  increments  in  the  values: 
the  relation  of  direct  proportion  is  equivalent  to  that  of  equal  increments  in 
the  argument  producing  equal  increments  in  the  values.  It  is  obvious  that 
direct  proportion  requires  that  equal  increments  produce  equal  increments. 
When  equal  increments  produce  equal  increments  it  follows  that  for  each  non¬ 
negative  h  and  all  non-negative  x  and  y  the  equation  f(x  +  h)  -  f(x)  =  f(y  +  h)  -  f(y) 
holds.  Hence,  as  f (0)  =  0  it  follows  that  f(x  +  h)  =  f(x)  +  f(h).  Now  if  n  is  a 
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positive  integer,  f(nx)  =  f(n  -  lx  +  x)  =  f(n""^  lx)  +  f(x)  so  that  f(nx)  =  nf(x). 

Similarly  f(x)  =  f(n£)  =  nf{^)  so  that  f(— )  =  —  f(x).  Let  m  be  a  positive  integer 
n  n  n  n 

so  that  —  is  an  arbitrary  positive  rational.  Then,  if  r  =  —  it  follows  that 
n  n 

f(rx)  =  f(m^)  =  mf(^)  =  -^j-f(x)  =  rf(x).  As  f  is  continuous  it  follows  that  for  any 
real  a>0  the  equation  f(ax)  =  af(x)  holds.  Therefore,  with  a  =  x"  \  it  follows 
that  f(x)  =  f(l)x  as  was  to  be  shown. 

Considering  the  balance  requirement  from  the  vantage  of  this  equivalent 
of  direct  proportion  facilitates  framing  the  requirement  more  unambiguously. 
Increments  in  the  work  assigned  can  be  interpreted  as  'equal'  in  two  distinct 
cases;  when  all  increments  are  the  value  of  the  same  random  variable  so  that 
all  increments  are  equal  in  the  ordinary  sense;  and  when  all  the  increments 
are  identically  and  independently  distributed  and  are  'equal'  in  an  extended 
sense.  The  equality  of  increments  of  the  work  assigned  can  be  similarly 
defined.  Thus,  the  balance  requirement  can  be  stated:  when  equal  increments 
of  work  assigned  produce  equal  increments  of  the  work  accomplished  the 
effectiveness  remains  constant,  or 
ASSUMPTION  II 

If  the  families  of  non-negative  random  variables  S*,  S*,  .  . .  ,  S*  and 

1  N 

W*,  W*,  .  .  .  ,  respectively  are  identically  and  independently 
distributed  or  are  respectively  the  values  of  two  random  variables 
(possibly  dependent)  then, 

ef(S*,  W*)  =  ef(S*  +  .  .  .  +  S*.  W*  +  . .  .  +  Wfc)  (2) 

1  N  1  w 
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The  intended  interpretation  is  that  S*,  S* . respectively  represents 

the  work  accomplished  on  the  respective  assignments  W*,  W* . W*^. 

Unfortunately,  this  assumption  appears  more  complex  than  it  is,  and  further 
elaboration  must  be  deferred  to  the  next  section. 

The  next  requirement  governs  those  cases  in  which  it  is  necessary  to 
consider  limiting  operations  on  the  effectiveness  functional.  Since  it  is 
clearly  necessary  that  systems  with  identically  distributed  work  assigned 
and  work  accomplished  have  the  same  effectiveness,  it  seems  necessary  to 
require  that,  as  the  assignments  and  accomplishments  of  a  given  system 
become  probabilistically  indistinguishable  from  a  limiting  assignment  and 
accomplishment,  the  effectiveness  too  must  become  indistinguishable  from 
that  of  the  limiting  assignment  and  accomplishment.  Therefore, 
ASSUMPTION  III 

If  S*  converges  to  S#  almost  everywhere  and  W*  converges  to  W* 
almost  everywhere,  then 

ef(S*,  W*)  =  lim  ef(S*,  W*  )  (3) 

n  m 

n,  m— »- oo 

Here  convergence  almost  everywhere  is  taken  as  in  Halmos  I:  if  X*  converges 

almost  everywhere  to  X*,  then  the  probability  that  lim  X*  #X*  is  zero  so 

n-*-oo 

that  as  n  increases  X*  becomes  indistinguishable  from  the  limiting  random 
variable  X*. 
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Usually  the  work  "system"  is  used  ambiguously.  On  one  hand  it  is 
used  to  designate  particular  hardware  items  and  a  more  or  less  specific 
operating  procedure,  and  on  the  other  an  aggregate  of  these  items  from  the 
aspect  of  their  common  structure,  design,  and  use.  Here  "system"  will  be 
taken  to  mean  the  latter.  "System  instance"  will  be  reserved  for  the 
individual  hardware  items  belonging  to  the  system  aggregate.  More  formally, 
a  system  is  any  well  defined  collection  of  system  instances  for  which  there 
exists  an  instruction  for  allocating  the  work  assigned  to  the  system  to  its 
instances  and  an  instruction  governing  the  operation  of  each  of  the  instances 
on  the  assigned  work. 

From  the  vantage  of  these  definitions  it  is  so  natural  to  identify  the 

<> 

work  done  by  the  system  with  the  totality  of  work  done  by  its  instances  that 
it  is  clear  that  such  an  assumption  is  quite  reasonable.  Let  G  be  a  set  of 
goals  and  CQ  CT  G  be  those  assigned  a  given  system.  Then  the  i-th  instance 
of  the  given  system  will  accomplish  some  random  set  A*  Cl  Gq  of  goals.— ^ 

Let  V  be  a  function  which  assigns  to  each  set  of  goals  the  real  number 
representing  the  work  or  value  associated  with  the  set  of  the  goals,  then 
ASSUMPTION  IV 

If  the  goals  accomplished  by  the  i-th  instance  of  a  system  with  N 

instances  are  A*  (i  =  1 . N)  and  if  the  goals  accomplished  by  the 

system  are  A*  then 

1/  For  a  discussion  of  random  sets  see  Appendix  I 
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(4) 


A*  =  A*  UA*  U  . . .  UA* ; 

12  N 

and  if  the  value  function  V  is  a  measure  on  a  V  -ring  of  subsets  of 

G  then 
o 

V(A*)  =  V(A*)  +  ...  +  V(A*)  (5) 

1  N 

so  that  the  work  done  by  the  system  is  the  sum  of  the  work  done  by 
the  instances. 

Now  if  a  system  of  N  identical  instances  is  considered;  and  if  each 
instance  is  assigned  the  amount  W*,  and  if  each  instance  accomplishes  S*, 
then  by  (5)  and  (2) 

ef(S*,  W*)  =  ef(NS*,  NW*).  (6) 

S*  W# 

Since  S*  can  be  replaced  by  —  and  W*  by -  it  follows  that 

N  1  N 

ef(S*  W*)  =  ef{^,  ™1)-, 

and  if  S*  is  replaced  by  MS*  and  W*  by  MW  *  for  positive  integer  M  that 

ef(tyS*,  MW*)  =  ef(rS*,  rW*) 

for  r  =  — ;  and  therefore  by  (6)  that 
N  7 

ef(S*,  W*)  =  ef(rS*,  rW*)  (7) 

in  which,  of  course,  r  can  be  any  positive  rational.  If  a  is  any  real  number, 

there  is  a  sequence  of  rationals  aR  such  that  a  =  lim  an<  By  (7) 

n-»-oo 

ef(S*,  W*)  =  ef(anS*,  anW*) 

so  that 

ef(S*,  W*)  =  lim  ef(anS*.  anW*). 
n  oo 
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As  *nS*  and  a^W*  converge  almost  everywhere  to  aS*  and  aW*  respectively, 
it  follows  that 

ef(S*,  W*)  =  ef(aS*,  aW*)  (8) 

or  the  effectiveness  is  invariant  with  respect  to  dimension  change. 

An  instance  of  any  system  can  be  conceived  as  belonging  to  another 

system  composed  of  replicas  of  the  given  instance,  all  of  which  are 

probabilistically  the  same.  If  the  original  instance  in  its  original  system 

is  assigned  the  work  W#  and  accomplishes  the  work  S*,  then  each  replica 

in  the  system  of  replicas  can  be  conceived  to  have  the  assigned  work  W#  and 

i 

accomplish  S*  (for  the  i-th  replica).  The  S#  and  the  W*  can  also  be  conceived 
i  i  i 

as  families  of  independent  random  variables.  In  such  a  case  it  appears  quite 

reasonable  that  the  effectiveness  of  the  system  of  replicas  should  be  independent 

of  the  number  (greater  than  zero)  of  replicas  involved.  This  independence  is 

in  fact  guaranteed  by  assumption  II;  so  that  as  assumption  IV  allows  the  total 

assigned  work  to  be  represented  as  the  sum 

W*  =  W*  +  . . .  +  W*  (9) 

T  1  N 

and  the  total  accomplished  work  by  the  sum 

S*  =  S*  +  . . .  +S*  (10) 

T  1  N 

it  follows  by  assumption  II  that 

ef(S*,  W*)  =  ef(S*,  W*).  (11) 

T  T 

Since  equation  (8)  holds  for  any  permissible  S*  and  W*  it  also  holds  for  S*  /N 

T 

and  W*  /N.  Hence 
T 
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ef(S*,  W*)  =  e£(NS* /N,  NW* /N)  =  ef(S*/N,  W* /N); 
and  therefore 

ef(S*.  W*)  =  lim  ef(S*/N,  W*  /N).  (12) 

N—co  T  T 

It  is  now  only  necessary  to  evaluate  the  limit  on  the  right  of  (12).  By  (9) 
and  (10)  it  follows  that 


1  1 


Since  the  variances  of  the  S*  and  the  W*  can  be  assumed  finite,  it  follows  by 

i  i 

the  strong  law  of  large  numbers  that  S*  /N  and  W# /N  respectively,  converge 
almost  everywhere  to  the  expected  values  ES*  and  EW*.  Therefore,  by 
assumption  III  it  follows  that 

ef(S*,  W*)  =  ef(ES*,  EW*),  (13) 

an  important  result  which,  independently  of  assumption  I,  states  that  the 
effectiveness  of  any  system  is  dependent  only  on  the  expected  values  of  the 
work  assigned  and  the  work  accomplished.  In  fact,  if  in  (8)  a  is  chosen 
equal  to  1/EW*,  then 

ef(S*,  W*)  =  e£(ES*/EW*,  1)  (14) 

so  that  the  effectiveness  depends  only  on  the  ratio  of  the  average  work 
accomplished  to  the  average  work  assigned,  regardless  of  the  distributions 
involved  provided  they  have  a  finite  variance. 
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If  in  (8)  S*  and  W*  are  replaced  by  S  and  W  respectively,  then  by 
assumption  I 

ef(aS,  aW)  =  C(aW)aS 
so  that  if  a  =  1/W  then  by  (8) 
ef(S,  W)  =  C(1)S/W. 

Thus  if  C{1)  is  taken  to  be  1  then  by  (13) 

ef(S*,  W*)  =  ES*/EW*.  (15) 

Therefore,  if  the  work  assigned  and  the  work  accomplished  have  finite 
variances  the  effectiveness  of  the  system  is  the  ratio  of  the  average  work 
accomplished  to  the  average  work  assigned. 

As  a  simple  illustration  of  this  result  consider  a  case  in  which  the 
system  is  to  accomplish  N  similar  objectives,  which  are  such  that  the  system 
has  a  probability  p  of  accomplishing  any  one.  If  no  other  factors  are  involved 
and  the  value  associated  with  each  such  objective  is  unity,  then  the  work 
assigned  is  simply  N  and  the  work  accomplished  has  a  binomial  distribution 
with  mean  Np;  so  that  by  (15)  the  effectiveness  is  simply  p.  If  the  number 
of  objectives  were  itself  random,  say  with  a  binomial  distribution,  having  rN 
as  mean,  then  the  work  accomplished  has  a  binomial  distribution  with  mean 
Nrp.  Thus,  as  might  be  expected,  by  (15)  the  effectiveness  is  again  p.  In 
the  event  that  there  is  a  random  mixture  of  goals  such  that  a  goal  of  the  i-th 
type  occurs  with  the  relative  frequency  r^  and  has  an  associated  value  V.  and 
the  system  has  a  probability  p.  of  accomplishing  a  goal  of  the  i-th  type,  then 
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the  effectiveness  is  simply 


when,  now,  N  is  the  number  of  types  involved.  In  the  event  that  the  goals 
have  unit  value  but  are  such  that  the  system  has  a  probability  1-S  of  being 
rendered  inoperative  by  an  engagement  with  one,  then  the  number  of 
engagements  survived  has  a  geometric  distribution.  If  S  is  the  survival 
probability  then  pSn  ^  is  the  probability  that  the  n-th  goal  is  accomplished. 
Hence,  if  N  goals  are  assigned,  the  effectiveness  is 


N  '  1-S 

If  S  goes  to  1  then  the  effectiveness  goes  to  p  as  before.  However,  if  as 

before  a  random  number  of  goals  is  assigned,  having  a  binomial  distribution 

with  mean  Nr,  the  effectiveness  is 

N 

_E_.  1-(1  -  r  +  rS)  , 
rN  1-S 

and  is  no  longer  in  either  case,  independent  of  the  number  of  goals  assigned. 

A  final  and  less  trivial  example  can  be  derived  from  the  illustration 
of  Appendix  I.  There  it  is  shown  that  a  missile  with  a  circular  normal  damage 
function  specified  by  the  standard  deviation  functioning  at  a  point  with  a 
circular  normal  distribution  specified  by  the  standard  deviation  <Tg  relative 
to  a  target  with  a  total  value  VQ  spread  out  with  a  circular  normal  density  of 
standard  deviation  <r  accomplishes  the  average  work 
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2 


V 

_ o  D _ 

<r2+<r2+<r2 
D  B  T 

2  2  2  2 

Since  the  work  assigned  is  V  .  vhe  effectiveness  is  O'  /(  <r_  +  O’  +<r  ). 

°  o’  D  D  B  T 

If  instead  of  a  particular  target  with  the  spread  O  the  target  is  of  a  random 
spread  uniformly  distribute  1  from  to  S^,  then  so  long  as  the  total  value  is 
not  dependent  on  spread  the  effectiveness  is  by  (15) 


<S2-S1>V°D  + 


i  ^b2 

<T  2  +  <T  2  +  S,  S. 

D  B  1  2 


In  the  event  that  V'  is  depe-  dent  on  O'  ^  a  more  complex  expression  holds. 
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APPENDIX  I 


THE  EXPECTED  VALUE  OF  THE  RANDOM 
MEASURE  OF  A  RANDOM  SET 

The  purpose  of  this  appendix  is  to  make  mathematically  precise  the 
notion  of  a  random  set  and  a  random  measure  on  a  random  set  and  to  develop 
a  formula  to  compute  its  expected  value.  Finally,  an  illustrative  example, 
with  relevance  to  effectiveness  computations  is  demonstrated. 

In  1944  H,  E.  Robbins  introduced  the  notion  of  a  random  set  (Robbins  I) 
and  proved  a  theorem  concerning  the  moments  of  its  Lebesgue  measure.  This 
paper  was  followed  by  another  (Robbins  II)  in  which  the  theorem  is  applied  to 
a  problem  of  Bronowski  and  Neyman  (Bronowski  and  Neyman  I).  For  the 
purposes  of  effectiveness  theory  it  is  necessary  to  generalize  these  results 
of  Robbins  in  order  to  allow  non-uniform  value  distributions  which  themselves 
may  be  random. 

Although  with  minor  modifications  the  argument  herein  presented 

generalizes  Robbins'  results  for  all  moments  of  a  <T -finite  measure  of  a 

random  set,  only  the  case  of  the  first  moment  is  considered;  since  only  the 

first  moment  if  relevant  to  an  effectiveness  computation. 

In  Robbins  I  a  random  set  is  defined  by  analogy  with  an  example: 

X*  (n  =  1 .  N)  is  a  sequence  of  N  independently  and  identically  distributed 

n 

random  variables  on  a  se ament  of  the  real  line.  About  each  X*  is  centered 

n 

an  interval  of  unit  length.  These  intervals  and  their  unions  are  random  sets. 


In  this  appendix  a  measure-theoretic  definition  is  introduced,  the  results  are 
generalized  to  the  O’  -finite  case,  measures  which  are  themselves  random 
variables  are  considered,  and  the  proofs  are  simplified  considerably. 
Throughout,  unless  the  contrary  is  stated,  the  measure-theoretic  nomenclature 
is  that  of  Halmos1  Measure  Theory  (Halmos  I). 

Given  are  a  probability  space  ( &  ,  ,  p)  and  a  or  -  finite  measure 

space  (R,  R,  V).  Loosely  the  interpretation  is  that  (Si  ,  Si  ,  p )  carries 
the  random  element  of  a  system's  interaction  with  its  goals  in  R  and  (R,  R,  V) 
carries  the  value  element  in  that  if  Rq  <  R  is  a  set  of  goals  accomplished  by 
the  system,  then  V(RQ)  is  the  value  of  the  accomplishment.  If,  for  example, 

R  were  a  target  represented  by  the  Euclidian  plane,  then  V  might  be  the 
Lebesgue-Stieltjes  measure  induced  by  the  personnel  density  function. 

(  Q  ,  S  ,  p)  might  carry  the  random  impact  point  of  a  missile  and  its  random 
lethal  area.  However,  since  the  random  interaction  of  the  system  with  its 
goals  is  not  necessarily  independent  of  the  goals,  attention  will  be  focussed 
on  the  product  space  (  SlXR,  HxR,  p  XV). 

Let  S  be  a  measurable  subset  of  SI  XR,  that  is  S*  SXR.  EachS 
determines  a  natural  mapping  of  SI  into  R,  the  measurable  subsets  of  R:  let 
Sty  be  an  -section  of  S  and  for  each  u  e  SI  pointwise  define 

S*(W)=SW.  (1-1) 

As  all  sections  of  a  measurable  set  are  measurable,  S*  maps  SI  into  R.  The 
mapping  S*  is  the  random  set  on  R  generated  by  S.  As  at  least  the  countable 


* 
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union  and  the  relative  complement  of  measurable  subsets  of  &  XR  are 
measurable,  the  random  sets  on  R  form  a  <r  -ring  when  pointwise  definitions 
of  union  and  relative  complement  are  given. 

As  a  consequence  of  35  A  Halmos  I,  V(SW  )  is  a  p-measurable  function 
of  (0  ,  and  consequently  V (S*)  can  be  considered  a  random  variable  in  the 

r 

ordinary  sense.  Also,  when  S  is  an  r- section  of  S,  the  same  theorem  yields 


fa 


V(SW  )dp(  Ctf  )-  = 


p(Sr)dV(r) 


d-2) 


The  left  of  (1-2)  is  familiar  as  the  usual  definition  of  the  expected  value  of  a 
random  variable.  Thus 


E  [v(S*)l  =  f  P(Sr)dV(r),  (1-3) 

■'R 

when  E  is  the  expectancy  functional.  The  set  Sr  is  by  definition  | OJ  :  (CJ  ,  r)  €  s| , 
But  as  (a)  ,  r)  €  S  if  and  only  if  r  «  S#(o>)  it  can  be  identified  with  the  event  that  r 
is  in  S*.  Hence  p(Sr)  is  the  probability  that  r  €  S*.  Accordinglv  if  reference 
to  the  space  is  dropped  and  'Pr'  is  used  to  designate  the  probability  of  an 
event,  (1-3)  gives  rise  to  the  basic  theorem  for  the  expected  value  of  the  O*  -finite 
measure  of  a  random  set: 


E[v(S*)]  =  [  Pr(r€  S’*)  dV(r)  (1-4) 

L  •'R 

Equation  (1-4)  generalizes  Robbins  I  to  the  ease  of  O'  -finite  V,  and  supplies  a 
useful  tool  for  the  computation  of  effectiveness.  Also  from  the  definition  of  a 
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product  measure  it  follows  that 

E  [V<S*)]  =  (PXVHS),  (I  -5) 

or  that  the  expected  value  of  the  V-measure  of  the  random  set  is  the  product 
measure  of  its  generating  set. 

For  some  effectiveness  computations  it  is  necessary  to  consider  value 

.measures  which  depend  on  conditions  that  can  be  specified  only  randomly. 

These  cases  require  a  notion  of  random  measure,  and  require  the  computation 

of  the  expected  value  of  the  random  measure  of  a  random  set.  To  fix  the  idea 

of  a  random  measure  consider  another  probability  space  (&  ' ,  Si  p')  which 

is  such  that  for  almost  all  there  is  a  totally  finite  value  measure 

on  (R,  R).  Then  (Halmos  I,  36.  3)  for  R  €  R  and  0(  W)  =  V*fcj.(R  )  the  function 

o  w  o 

0  is  p'-measurable  and,  consequently,  suppressing  the  <tf  V*(Rq)  is  a  random 
variable  in  the  ordinary  sense.  In  this  sense  a  random  measure  V*  is  defined 
for  (R,  R).  Now  as  Pr(r  €  S*)  is  a  non-negative  measurable  function  on  R,  it 
follows  that  (Halmos  I,  36.  3) 


f (*>')=/  Pr(r«  S*)  dVw-  (r), 

the  expected  value  of  the  measure  of  S*  given  that  V*  =  V^',  is  measurable  on 
fi  1  and  that 


f(  to  ' ) d p '  ((!)')  = 


Pr(r  €  S*)d  (EV*)(r) 


when  EV*  is  the  expected  measure  as  defined  by 


(1-6) 


% 
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(EV*)(R  )  =  /  V  <R0)dp'(«'). 

JQ' 

Thus,  as  the  left  of  (1-6)  is  by  definition  the  expected  value  of  ,(S*),  it 
follows  that 

E  [v*(S*)]  =  J  Pr(rf  S#)d  (EV*)(r).  (1-7) 

Equation  (1-7)  shows  that  insofar  as  effectiveness  computations  are 

concerned,  a  random  measure  can  be  treated  in  the  same  manner  as  a  non- 

random  measure  by  using  its  expected  value.  In  this  sense  (1-7)  is  a  further 

generalization  of  (1-4);  however,  in  the  derivation  of  (1-7)  the  assumption  of 

flr -finite  measure  is  replaced  by  one  of  a  totally  finite  measure.  But,  as 

value  measures  usually  can  be  considered  totally  finite  no  important  restrictions 

are  thereby  imposed  on  an  effectiveness  computation. 

Now  it  is  desirable  to  show  that  the  product  space  representation  of 

the  requirements  for  an  effectiveness  analysis  is  essentially  complete.  This 

is  to  be  accomplished  by  generalizing  (1-5)  as  (1-6)  is  generalized.  Thus,  not 

only  allow  the  value  measure  (again  totally  finite)  to  depend  on  conditions  that 

can  be  specified  only  randomly  but  also  allow  p  to  be  so  dependent.  Accordingly, 

for  each  <i) 1  t  Q  '  let  p  ,  XV  be  a  totally  finite  measure  on  (  &  XR,  ft  XR) 

*  (J  * 

Then  for  S  €  S  XR  and  0(  W  ’)  =  (p  XV  )*(S)  the  function  0  is  p' -measurable 

W  *  Cft) ’ 

as  before  By  (1-5),  9(d)  ')  is  the  conditional  expectation  of  the  random  set 
generated  by  S.  Since  9  is  measurable  and  finite  it  is  integrable.  Therefore, 
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(1-8) 


E  [v*(S*)]  =  f  0(«')dp(»') 

JSS 

and  as  before  define  an  expected  measure  X  by 
X  (S)  =  f  0«V  ')dp(»  •) 

Ja' 

so  that  by  (1-8),  in  analogy  with  (1-5),  it  follows  that 

e[  V*(S*)]  =  X  (S),  (1-9) 

and  therefore  that  (  flXR,  Si  XR,  X  )  is  sufficient  to  determine  the  effectiveness. 

Continuing  in  this  vein  it,  of  course,  follows  that  if  only  the  p-measure 
on  (Si  ,  )  is  randomized,  or  if  both  measures  are  independently  randomized 

an  equation  of  the  form  (1-3)  can  be  shown  to  hold  with  p  or  V  replaced  by  Ep* 
or  EV#  as  the  case  may  require.  Thus,  in  many  cases  the  effectiveness  is 
representable  by  (1-4)  through  suitable  choice  of  p  and  V.  In  all  cases  of 
practical  significance  it  is  representable  by  (1-9)  and  therefore  the  effectiveness 
problem  is  essentially  specified  by  (  Si  XR,  &  XR,  X  )  in  which  (SI  ,  S.  )  is 
an  event  space  (R,  R)  a  goal  space  and  X  a  totally  finite  measure  on  their 
product  .space. 

It  is  to  be  .emphasized  that  the  above  characterization  is  not  to  be 
considered  final.  On  a  general  and  abstract  level  it  appears  suitable  and 
adequate.  Such,  however,  is  not  to  state  that  the  characterization  is  adequate 
for  unforeseen  complex  problems. 

As  an  illustrative  example  of  these  techniques  consider  the  following: 
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CONDITIONAL  EFFECTIVENESS 

The  notion  of  conditional  effectiveness  is  an  outgrowth  of  the 
application  of  the  preceding  development  of  effectiveness  to  the 
determination  of  the  degree  to  which  a  component  of  a  system  contributes 
to  the  effectiveness  of  the  system.  The  aim  is  a  quantitative  measure  of 
how  well  a  particular  component,  or  a  characteristic  of  a  particular  component, 
functions  in  relation  to  the  rest  of  the  system.  Such  a  measure  should  be  of 
value  in  the  rapid  assessment  of  system  weak-links,  and  should  serve  as  an 
indicator  of  which  elements  of  a  system  could  be  improved  most  profitably. 

To  establish  such  a  measure  in  the  context  of  the  previous 
developments  it  is  first  necessary  to  determine  the  work  assigned.  Since  a 
relative  measure  is  required  it  seems  natural  to  define  the  work  assigned  as 
the  work  that  would  be  accomplished  by  the  system  were  the  component  in 
question  functioning  perfectly.  Such  a  definition  seems  to  properly  account 
for  the  limitations  imposed  on  the  performance  of  the  component  in  question 
by  possible  inadequacies  and  mismatching  of  other  system  components.  With 
the  work  assigned  so  defined  the  work  accomplished  can  be  identified  with  the 
work  accomplished  by  the  entire  system. 

As  an  example  consider  a  system  composed  of  N  components  each 

with  a  probability  p^(i  -  ) . N)  of  proper  performance.  Then  the  conditional 

effectiveness  of  the  k-th  component  is  simply 
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Attn:  Maj.  Arne  H.  Eliasson 

Library 

Boulder  Laboratories 
National  Bureau  of  Standards 
Boulder,  Colorado 

Institute  of  the  Aerospace  Sciences,  Inc. 

2  East  64th  Street 
New  York  21,  New  York 
Attn:  Librarian 

Office  of  Naval  Research 
Branch  Office,  London 
Navy  100,  Box  39 
F.  P.  O.  New  York,  New  York 

Massachusetts  Institute  of  Technology 
Research  Laboratory  of  Electronics 
Building  26,  Room  327 
Cambridge  39,  Massachusetts 
Attn:  John  H.  Hewitt 

Alderman  Library 
University  of  Virginia 
Charlottesville,  Virginia 


of  Copies 


1 


2 


1 


10 


1 
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Code 
AF  55 

AF  63 

AF  120 

AF  141 

AF  143 

AF  179 

AF  184 

AF  238 

AF  241 

Ar  25 

M  49 

I  651 


Organization 


WADD  (WCLN) 
Wright-Patterson  AFB,  Ohio 

WADD  (WCLR) 
Wright-Patterson  AFB,  Ohio 

RADC  (RCU) 

Griffiss  AFB,  New  York 

WADD  (WCLJ) 

Wright-Patterson  AFB,  Ohio 

RADC  (RCE) 

Griffiss  AFB,  New  York 


AFOSR  (Cr.  Harold  Wooster) 
Director,  Research  Information  Offic 
Washington  25,  D.  C. 

Hq.  USAF  (AFDRD) 

Washington  25,  D.  C. 

RADC  (RCW) 

Griffiss  AFB,  New  York 

RADC  (RCSGPR,  Milton  V.  Ratynski) 
Griffiss  AFB,  New  f  ork 


ARDC  Office 
USASRDL 

Fort  Monmouth,  New  Jersey 
ESD  (ESRHC) 

Attn:  Dr,  Joseph  M.  Doughty 

L.  G.  Hanscom  Field,  Bedford,  Mass 


Bolt,  Beranek  and  Newman 
50  Moulton  Street 
Cambridge  38,  Massachusetts 
Attn:  Dr,  Thomas  Marill 
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Code 
I  729 

I  85 

I  758 

I  777 

I  897 

N  37 

N  85 

N  93 


Organization  No.  of  Copies 

General  Electric  Company 
Technical  Military  Planning  Operation 
735  State  Street 
Santa  Barbara,  California 

Attn:  Mr.  George  P.  Mandanis  1 

Motorola,  Inc. 

8201  East  McDowell  Road 
Phoenix,  Arizona 

Attn:  Dr.  Thomas  E„  Tice  1 


The  Mitre  Corporation 
P.  O.  Box  208 

Lexington  73,  Massachusetts 
Attn:  Mr.  Russell  R.  Shorey,  D-17 

Planning  Research  Corporation 
10970  LeConte  Avenue 
Los  Angeles  24,  California 
Attn:  Mr.  Irving  Carfunkel 

Cornell  Aeronautical  Lab.  ,  Inc. 

4455  Genesee  Street 
Buffalo  21,  New  York 
Attn:  Mr.  Edwin  W.  Roth 

Office  of  Naval  Research 
Department  of  the  Navy 
Washington  25,  D.  C. 

Attn:  Code  427,  Electronics  Branch 

Commanding  Officer  and  Director 

U.  S.  Navy  Electronics  Laboratory  (Library) 

San  Diego  52,  California 

Commanding  Officer 

U.  S.  Naval  Ordnance  Laboratory 

Corona,  California 

Attn:  Documents  Librarian 


1 


1 


1 


1 


1 


1 
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Code 
N  146 

U  26 

U  79 


U  83 

U  97 

U  319 

U  336 

U  369 


Organization  No,  of  Copies 

Office  of  Naval  Research 
Department  of  the  Navy 
Washington  25,  D.  C. 

Attn:  Code  418  1 

Massachusetts  Institute  of  Technology 
Lincoln  Laboratory 
P.  O.  Box  73 

Lexington  73,  Massachusetts 

Attn:  Mary  A.  Granese,  Librarian  1 

University  of  Michigan 
Engineering  Research  Institute 
Radiation  Laboratory 
Attn:  Prof.  K.  M.  Siegel 
912  North  Main  Street 

Ann  Arbor,  Michigan  1 

The  Librarian 
Department  of  Physics 
University  of  Illinois 

Urbana,  Illinois  1 

Polytechnic  Institute  of  Brooklyn 

Microwave  Research  Institute 

55  Johnson  Street,  Brooklyn,  New  York 

Attn:  Mr.  A.  E.  Laemmel  1 

Ohio  State  University 
1314  Kinnear  Road 
Columbus  8,  Ohio 

Attn:  Laboratory  of  Aviation  Psychology  1 

Northeastern  University 
360  Huntington  Avenue 
Boston,  Massachusetts 

Attn:  Prof.  Ladislav  O.  Dolansky  1 

Massachusetts  Institute  of  Technology 
Department  of  Mechanical  Engineering 
Cambridge  39,  Massachusetts 
Attn:  Prof.  Thomas  B.  Sheridan 

Dynamic  Analysis  k  Control  Lab.  1 


Code 
U  375 

U  376 

U  397 


Organization 

Northeastern  University 
360  Huntington  Avenue 
Boston  15,  Massachusetts 
Attn:  Prof.  R.  H.  Moody,  Library 

% 

Massachusetts  Institute  of  Technology 
Operations  Research  Center 
Room  6-218 

Cambridge  39,  Massachusetts 

Case  Institute  of  Technology 
University  Circle 
Cleveland  6,  Ohio 
Attn:  Burton  V.  Dean 


AFCRL,  Office  of  Aerospace  Research  (CRRI) 
L.  G.  Hanscom  Field,  Bedford,  Massachusetts 


